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© Video merchandising apparatus and method. 

© A multimode video merchandiser system utilizes two levels of inductive learning to derive rules for selecting 
the sequence in which images of products stored on a videodisc are presented on a video monitor to a user. 
The first level of inductive learning generates rules from market survey based, consumer profile attributes 
assigned to items selected by previous users to determine the profile of the consumer most likely to be using 
the system at any given time, and to present the items in a sequence most likely to appeal to such a user. The 
second level of inductive learning utilizes a set of product characteristic attributes assigned to items selected by 
the current user to determine that user's preferences, and to modify the sequence of presentation to display first 
those items possessing the preferred characteristics. 
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VIDEO MERCHANDISING APPARATUS AND METHOD 

This invention relates to an apparatus and a method for displaying images of merchandise items to 
prospective customers in sequence and more particularly to such an apparatus and method which employ 
artificial intelligence to- customize the presentation to most effectively address the prospective customer's 
interests. 

It is becoming common today for merchandisers to utilize video systems to generate consumer interest 
in their products. The typical system displays images of a number of items in a fixed sequence. Some 
systems allow the user to select a particular group of items for review. For instance, the user may be 
offered the option of viewing any one of several styles of furniture. However, even in these systems the 
menu of selections available is fixed and the group of products selected is always presented in the same 
sequence. One of these known fixed menu systems will provide specifications if more detail about an item 
is requested, and will check a main frame computer memory to determine if a product is available but 
again the order of presentation of items is fixed. 

One system in, use allows the user to indicate what features of a given product are most important and 
then selects items for presentation based on those features. For instance, if a user is interested in television 
is sets and indicates a particular interest in t3 inch color sets, with remote control and selling for less than a 
given pnce. the system will attempt to find items meeting those specifications for display. If none are found 
me least important features are successively dropped, without the knowledge of the user, until a match is 
tound. Again, however, the sequence in which items meeting the selected specifications are presented to 
the consumer is always the same. 

As the number of items in the system and their diversity increase, it is possible to discourage users 
who have particular interests, by making them view the fixed sequence of items, many of which have little 
appeal to them, before items are presented which may be of interest Jt would be desirable therefore to be 
able to identify the type of person using the system in order to present first items which will most likely 
appeal to that type of person. However, it has been found that if persons are asked directly for information 
about themselves which would be helpful in determining what type of products would appeal to them such 
as age, income bracket etc., the results are often not very reliable. 

It has been determined that certain types of persons tend to shop at certain times. However, the trends 
are not so well defined that a rigid system can be reliably based upon them. 

It is therefore, the primary object of the present invention to provide apparatus and a method for 
displaying items to the users of video merchandising systems which adapts to the pattern in which different 
types of persons shop. 

Accordingly, with this object in view, the present invention resides in a method of controlling a video 
system with a programmed digital computer to display to users in a controllable sequence images of a 
pluralrty of items, said method characterized by the steps of: generating an attribute file containing as to 
each item an assigned value for at least one selected attribute; establishing a list of said items sorted in the 
sequence to be presented by the video system based upon the assigned values of said at least one 
attribute; controlling said video system to display said items in the order of said list; providing means for 
users to generate inputs indicating interest in selected displayed items; generating a data file containing as 
to each user mput the item selected and a recurring time period during which the input was generated' 
determining from the attribute file the assigned value of said at least one attribute for each of the selected 
items in the data file; determining from the recurring time periods of the inputs and the assigned values of 
said at least one attribute for the selected items the most frequent value of said at least one attribute during 
each recurring time period; determining as to each item during the time period said input was generated the 
match between the assigned value of said at least one attribute and the most frequent value of said at least 
one attribute during that time period; and resorting said list of items in descending order of said match 
between the assigned value and the most frequent value during the time period said input was generated of 
said attribute, whereby the sequence in which said items are displayed changes in accordance with the 
responses of users during the respective time periods. 

The invention also resides in an apparatus for sequentially displaying to a number of successive users 
so merchandise items to which a plurality of attribute values indicative of the appeal of the item to selected 
classifications of users during a plurality of recurring time periods have been assigned, said system 
characterized by: a video recorder in which images of said items are stored; a video monitor on which said 
stored images are selectively displayed; interface means by which users generate inputs identifying 
displayed items in which they are interested; and a digital computer programmed to record the items 
identified by the inputs and a recurring time period during which each input was generated to apply an 
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inductive learning algorithm (IL1) to the attribute values of the selected items to determine the most likely 
attribute values of items selected by users during each of said recurring time periods, and to select the 
sequence in which the images stored in the video recorder are displayed on said video monitor in 
descending order of a match between the attribute values assigned to each item and said most likely 
5 attribute values for the current recurring time period. 

The preferred embodiment of the invention will be described by way of example, with reference to the 
accompanying drawings in which: 

Figure t is a schematic diagram of a video merchandising system incorporating the invention; 
Figures 2, 3, and 4 are decision trees illustrating the manner in which rules are generated in 
to accordance with the teachings of the invention; 

Figures 5a and b when placed end to end with the connections indicated by the encircled letters A 
and B. illustrate a flow chart of the software for the merchandiser system incorporating the invention; 

Figure 6 is an illustration of a video display generated by the merchandiser system incorporating the 
invention; 

rs Figure 7 is a flowchart of the software for executing the first level of inductive learning in accordance 

with the invention; 

Figure 8 is a flowchart of the software for executing the second level of inductive learning in 
accordance with the teachings of the invention; 

Figure 9 is a flowchart of the software for rearranging the list of items presented to the user as 

20 directed by the second level of inductive learning; and 

Figures 10a and b illustrate a flowchart of the software for the rule making algorithm used by the first 
level of inductive learning which is described in the appendix to this application. 

Figure 1 illustrates apparatus for carrying out the invention which includes a video monitor 1. a 
videodisc player 3. and a programmed digital computer 5. A suitable commercially available system is the 

25 Sony VIEW SYSTEM(TM) which includes their LDP 2000 laser videodisc player and SMC 2000 processor. 
A suitable user interface device 7 such as a touch screen attachment for the video monitor 1 provides 
means for the user to generate inputs to the system. 

Recorded images of the items to be presented by the system, and video demonstrations of at least 
some of those items, may be randomly accessed by the videodisc player for display on the monitor. 

30 Sequencing of the presentations is controlled by the programmed digital computer 5 which is interactive 
with the user through the video monitor touch screen 7. 

The system operates on the market principle that during certain hours of certain days a specific type of 
consumer will be shopping and that a video catalog presentation of the merchandise of interest can be 
customized to this type of customer. Through the use of an inductive learning program in conjunction with 

35 user input to an interactive computer, the frequency of inspection of a product is recorded when the 
consumer specifically requests more information about an item via an input device such as the touch 
screen 7. This data is then processed in an attempt to recognize viewer interest and to refine viewing 
patterns to present catalog items in a sequence most appealing to an individual viewer. Data from users is 
categorized and processed by time, day and month increments such that the video presentation will be 

40 customized to any time increment determined by user input For example, although hourly increments may 
be used to categorize the inputs, through the inductive learning executions, clusters of similar hourly 
patterns may emerge such that three individual hours with similar presentations will seem to "merge" to 
form a three hour cluster. Any time increment is possible, but the exemplary system will be sensitive to 
hourly, daily, and seasonal increments. 

45 The exemplary embodiment of the invention uses two separate inductive learning algorithms. The first 
algorithm which is used tor a first level of inductive learning by the system, incorporates an algorithm called 
ID3 described in an article by J. R. Quinlan entitled "Induction of Decision Trees" which appears in 
Machine Learning 1:81-106, Kluver Academic Publishers. Boston 1986. The second algorithm used at the 
second level of inductive learning is a less sophisticated program described below. Each of these 

50 algorithms requires a set of attribute values for each item of merchandise to be displayed. In the exemplary 
embodiment, the ID3 algorithm is used to evaluate a product gender value, a consumer income range for 
the product, and the age range of a consumer interested in the product. These values are the result of 
extensive market studies for each item of merchandise. The second less sophisticated algorithm evaluates 
attributes that identify the consumer's interest; such as whether the item is electronic, easy to clean, trendy. 

55 etc. It is to be understood that other or additional attributes may be utilized for the two levels of inductive 
learning. 
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u*TIL T, T J? 2 6 leamin9 iS US6d t0 determine the type of sh °PP er wh0 * most likely to be 
usng the system at the present time based upon the customer attributes of the items selected by previous 

S,te3 l Ca,Te ?^? n5time Pen ' 0dS - 7,18 rtemS *• ^Sed by how closely their consumer 
attribute profiles: matcir the assumed shopper. 

znJO.Ttr*!!?* t0 t 9U8SS Wh ° CUrrSnt CUSt0mer is ' ** 103 a, 9° ritnfn - as Ascribed by J. R. Quinlan. is 

Sf* "JT ^ ' temS ^ * Bn arran9Sd by h0W C,0S8, y ** ««™«- att^e profiles 
match the assumed shopper. p 

w ^Hl B f indUCti I e t ,earnin S Pr0CeSS ' S8VeraJ date files ^ used " There is 3 file whi <* Stores consumer 
profile data for each ,tem and a separate file used to store items viewed by users. These two files are then 
used to create data files actually accessed by the inductive learning process 

A very- short example will clarify the steps involved. For the purpose of demonstration all time 
parameters have been simplified. Time of day has been classified as working W l^SSdS <Z 

Sm« Q rn W ? ** W6ekdayS (Wd) ° f W6ekend (W6) days " and mon * s «• ^mmer (s) o? on- 

TZ^^TT^rf 6 Bnd ^ b6en Sel8Cted f ° r *• Purp0se of demonstration 

so that an interesting rule can be denved using a minimum of data records 

n m X!?Z*? Stnmet 30 intereSt 30 item ' *» system ^ in a file *e time of day and the 

product wh.ch was viewed. After several user interactions, the data file could look like this: 

TABLE 1 
User Response Data File 
Day af Week Month Hour item 

25 we s w Osterizer Blender 

we s nw Coffee Grinder 

we ns v Kitchen Center 

Applicance 

wd ns nw Electric Wok 



30 



40 



wd 



s w Self-Sharpening 



35 Scissors 



wd 



ns nw Toaster 



45 



we ns nw Hand Mixer 

Drofib^JS^ £f T 1 T 3 C ° nSUn,er attribUte pr0fHe aSSi9ned throu 9 h market search. The 
profile describes the type of person most often interested in this type of product by describino in the 

ZZ^T SU t 3 P8rSOn ' S 9ender ' and inC0me ™V ^ the time inZa S l^e 
attributes have been arbitrarily clustered for ease of demonstration as follows: 
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TABLE 2 

Consumer Attribute Categories 
Attribute Value Range 

Age < 25 

25 - 40 
> 40 



Value Assigned 
0 
1 
2 



15 



Gender 



20 



More Male Consumers 

Both Female and Male 
Consumers 

More Female Consumers 



0 
1 



30 



Income < $20K 

$20K - $40K 
> $40K 

The item consumer profile for several products look like this: 
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TABLE 3 



ID 



rs 



20 



25 



30 



Itenr Consumer 


Attribute 


Profiles 








Item 


Age 


Gender 


Income 


Ssterizear Blender 


(i 


2 


0) 


(0 2 


1) 


(1 


0 


2) 


Eand Mixer 


(i 


2 


0) 


(2 


1 


0) 


(1 


0 


2) 


Coffee Grinder 


(i 


2 


0) 


(1 2 


0) 


(1 


0 


2) 


Steam • Iran 


(2 


1 


0) 


(2 


1 


0) 


(0 


1 


2) 


SeLf -Sharpening 




n 


1) 


(1 


2 


0) 


(0 


JL 


2) 


Scissors 










Krteftsn. Center 


(2 


1 


0) 


(2 


1 


0) 


( 0 


2 


1) 


Appliance 










Electric Wok 


(1 


0 


2) 


CI 


0 


2) 


(1 


2 


0) 


Toaster 


(1 


0 


2) 


(1 


2 


0) 


(0 


1 


2) 


Le Chef Food 


(1 


2 


0) 


(1 


2 


0) 


(1 


0 


2) 


Processor 










Vista Food Processor 


(1 


2 


0) 


(2 


1 


0) 


(2 


1 


0) 



The parentheses enclose an ordered list of the attributes of the consumers who most frequently 
purchase the product For example, the Osterizer Blender most often is purchased by a consumer in the 
25-40 year old range (designated by the 1 in the first place of the first set of parentheses), followed by the 
35 people over 40, and least by people under 25. This complete ordered listing is needed for scoring items 
against the assumed consumer as will be described later. 

Using the item consumer attribute profiles of Table 2 and user response data of Table 1, three data files 
are built for the inductive learning process. For each record in the user response data file, an entry is 
created for each of the age data file, gender data file, and income data file by recording the time 
m information and the first value in the item's consumer profile attribute value list. For example, the first user 
response record (we s w Osterizer Blender) would create the following three entries: 

Age Data File (AGE. DAT) 
45 we s w 1 

Gender Data File (GEN. DAT) 

we s w 0 

Income Data File (INCOME.DAT) 

we s w 1 



50 



55 



The final data files for the example are as follows: 
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TABLE 4 
Example Data File 

5 



AGE. DAT 



TO 



• 


* 






we 


s 


w 


1 


we 


s 


nw 


1 


we 


ns 


w 


2 


we 


ns 


nw 


1 


wd 


s 


w 


2 


wd 


ns 


nw 


1 


we 


ns 


nw 


1 



GEN. DAT 



25 



we 


s 


w 


0 


we 


s 


nw 


1 


we 


ns 


w 


2 


wd 


ns 


nw 


1 


wd 


s 


w 


1 


wd 


ns 


nw 


1 


we 


ns 


nw 


2 



INCOME . DAT 



35 



40 



we 


s 


w 


1 


we 


s 


nw 


1 


we 


ns 


w 


0 


wd 


ns 


nw 


1 


wd 


s 


w 


0 


wd 


ns 


nw 


0 


we 


ns 


nw 


1 



45 

From these data files, the first level of the inductive process uses the ID3 algorithm, to derive a rule, in 
the form of a decision tree, that can be used to decide who is currently using the machine. According to the 
ID3 algorithm, the value of the information which would be gained by using a specific attribute as a 
branching node in the decision tree can be determined by the following formula: 
50 Gain(A) = l(overall) - E(A) 

(The gain that can be expected by using an attribute A as a branching node is equal to the Information 

content of the attribute less the expected information requirement). 

where: 
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ICarerall) = - g ^ P ^ Iog 2 — -2-^ - . . . - ^ ^ log 2 p+ n +n 



V 

ECA)=^ . 1 <Pi.-»i> 

where A is any attribute. 

p is the number of occurrences of value p for attribute A. 
n is the number of occurrences of value n for attribute A. 
and v is the total number of occurrences of attribute A. 
Looking only at the gender data file, the formula would be applied as follows: 

First we isolate the "classes" of the data file - or the results of the data records. In our case, the results 
are the consumer attribute values; 

^occurrences of Q = T 
Occurrences of t = 4 
Occurrences of 2 = 2 

Calculating the information content gives the following: 
«GEN) =1 logz l-£ log2 f-f log 2 § 
= 1.378 bits 

Now, isolating only the day-of-week attribute for the gender file, we get the following data table: 

TABLE 5 
Day-of-Week Attribute 
Summary for Gender File 
Day-of-Week Value Summary of Data 

we # records = 4 

# 0 values = 1 

# 1 values = 1 

# 2 values = 2 

# records = 3 

# 0 values = 0 

# 1 values = 3 

# 2 values = 0 
equation for we is: 

I = *log 2 Wlog2*- 1 logs f =1.50 
the equation for wd is: 



wd 



Using this data, the 
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I = § logz §-§ logz §-2 | 0g2 2 = o 

and the equation for the expected information requirement is: 
E(day-of-week) = j l(we) + | l(wd) 
= .857 bits 

5 

Therefore, to calculate the gain, we simply subtract the above E from the value of the overall 
information content calculated previously; 

Gain(day-of-week) = 1 .378 - .857 = .521 bits 
Similariy t the inductive learner derives: 
ra Gain(month) = .414 
Gain(hour) = 236 

The ID3 algorithm chooses the day-of-week attribute as the root node for the decision making tree 
because it has the maximum information value. The data is then divided based upon the value of the day- 
of-week attribute value: 

75 

TABLE 6 

Day-of-Week Decision Tree 
Root Node and Resulting Data Sets 

20 

* Day of Week 







wd 






we 




25 


ns 


nw 


1 


s 


w 


0 




s 


w 


1 


s 


nw 


1 




ns 


nw 


1 


ns 


w 


2 



30 



ns nw 2 



Notice the day of the week attribute has been removed from the data file. 

The same process described above is repeated for the month and hour attributes for each of the new 
data record sets. After the process is complete, the rule 10 illustrated in Figure 2 results. 

Similarly, rules 12 and 14 induced for the age and income data are shown in Figures 3 and 4. 

Notice on the income decision tree 14 shown in Figure 4 that the final leaves of the decision trees may 
be ordered lists of values, rather than a single value. This occurs if "rule conflicts" arise from the data. In an 
ordered list, the first value is the one most often seen, the second is the next most frequent value, etc. 

Once the rules have been established, they are used by the system to guess who is most probably 
using the system, and what kind of products that person prefers. To accomplish "best guessing", the 
system checks internal clocks to determine the time parameters, then executes the rules. The items in the 
database are then arranged according to how closely they match the rule results. For example, if a shopper 
enters the store at 10:00 AM on July 21, 1986, the system executes the rules for a summer weekday during 
working hours and determines that someone with the following attribute profile is most likely to be currently 
using the system: 



50 
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TABLE 7 

Sample Consumer Profile for Summer Weekdays During Normal Working Hours 

Age -2 
Gender - 1 
Income - 0 
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(In other words, all the retired people on Social Security are shopping now.) To re-order an item in the 
database, the product's consumer profile is checked against the above determined consumer profile and 
the- items are scored by how closely the profiles match. Items with the best scores (minimum in this case) 
are shown first. To score the items, a simple place-checking algorithm is used. If the consumer's first profile 
values exactly match the item's most common consumer profile, a score of 0 results. However if the 
profiles differ. T point is collected for each place the attributes do not match. For example, the hand mixer 
has the: following, consumer profile taken from Table 3: 



7tt 



20 



Age Gen Income 

Hand Mixer (12 0) (2 10) (10 2) 



Checking this profile against the determined current consumer profile, we see the assumed consumer's 
ig age is one place away from the first spot, so age gets a score 1 . Similarly, gender and income are both one 
place off and so they both get scores of 1 giving the hand mixer the composite score of 3. Similarly all 
other items in the data base are scored, then the items are sorted by score in ascending order 

Utilizing; this sample consumer profile and place checking algorithm, an ordered list of the sample items 
is generated which looks like this: 



TABLE 8 



Ordered List as Determined by 
Eirst Level of Inductive Learning 

25 







Score 




Self- Sharpening Scissors 


0 


30 


Kitchen Center Appliance 


1 




Steam Iron 


1 




Coffee Grinder 


2 


35 


Toaster 


2 




Le Chef Food Processor 


2 


40 


Hand Mixer 


3 




Self Sharpening Knives 


3 




Osterizer Blender 


4 


45 


Electric Wok 


4 




Gourmet Cutlery Set 


4 


50 


Vista Food Processor 


4 



55 



This list arranges the items in the order in which they are most likely to appeal to the assumed user of 
the system dunng the current time period selected for the example. As data accumulates, the profile of the 
assumed user could change based upon the selections made by previous users so that the list may be 
reordered based upon experience. The list will be automatically reordered to reflect both short term and 
long term trends in the times that different types of shoppers use the system. 
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The reordered list of items is used to determine the order in which items are presented to a user. The 
effects of reordering of the list are best seen in a browse mode of the system to be discussed below in 
which all of the items are displayed sequentially in the order of the list. The order,, however, also influences 
all other item retrievals which are also discussed below. If for example* the system is directed to access 
drink makers, the order in which those products are shown will be consistent with their placement in the 
ordered list 

The reordering of the database is only carried out between users. Once a user initiates a session, the 
order of items in the data base remains fixed until the session is terminated. Termination of use by a given 
user is ridicated by an input by the user so indicating, or by the elapse of a given interval following a 
request for an input by the system. If another user should begin using the system within the given interval 
so that the inputs appear to originate from the same user, there is no significant affect on the first level of 
inductive learning since it is the time the inputs were generated which is considered by the system and not 
whether they were generated by one or more, users. It will, however, result in a delay in reordering of the 
data base by the first level of inductive learning, and will have a very definite affect on the second level of 
inductive learning. 

The second level of inductive learning attempts to identify item characteristics which are interesting to a 
specific consumer. As with the first level of induction, data is collected for the personal inductive process 
when an item demonstration is requested. Instead of information about the item's consumer attributes, a 
second set of attributes which represents the user f s preference in the functional characteristics of the item 
is tracked. If the consumer is interested in items with the same characteristics, the second level of induction 
will converge on that pattern and arrange the sequence of items to be shown accordingly. Data is kept only 
for the user session, so each user creates his or her own set of important or preferred characteristics. 

In the item database, each item is related to a set of characteristics. A listing of this data using the 
items from the example above in order as determined by the first level of inductive learning, looks like this: 

TABLE 9 
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35 



40 



45 



50 



Item 



Item Functional Characteristics 

Characteristics 
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Osterizer Blender 
Hand Mixer 

Coffee Grinder 
Steam Iron 

Self-Sharpening Scissors 
Gourmet Cutlery 

Self-Sharpening Knives 
Kitchen Center Appliance 

Electric Wok 
Toaster 

Le Chef Food Processor 
Vista Food Processor 



electronic 

traditional, "easy to 
clean", simple 

trendy, compact 

electronic , traditional 

traditional , simple 

tradi ti onal , simple , 
bulky 

trendy 

bulky, electronic , 
complex 

trendy, "easy to clean" 
traditional, simple 
trendy, compact, simple 
trendy, bulky, complex 
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When- a demonstration of one of these items is requested, a number of things happen. First, a list of 
previously viewed- items is checked to make sure this item has not already been processed, as items are 
only processed, once for each consumer, if the item is a new one, the name is added to the "previously 
seen"' list the item's consumer attribute information is stored for the first level of induction, and then the 
rtem's characteristics, are processed. For each characteristic of an item, an entry is kept in the database 
stating : characteristic and the number of times that characteristic has occurred this user session. For 
fflcamplejfrthe consumer views the Hand Mixer, the following entries wouid result: 
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TABLE 10 

"Important Characteristics" Table 
Eallowing Demonstration of the Hand Mixer 

Characteristics # Occurrences 

traditional 1 

easy to clean 1 

simple 1 



When only one item has been demonstrated, no reordering of future presentations is done, because a 
characteristic is not considered significant unless it appears more than once. Thus, the above entry would 
25 cause no change in order. If, however, the consumer then looks at the toaster, the entries in the 
characteristic table look like this: 



30 



35 



40 



TABLE 11 

"Important Characteristics" Table 
Following Demonstration of the Toaster 

Characteristics # Occurrences 

traditional - 2 

easy to clean 1 

simple 2 



Now a significant trend is developing. 

An example will show how the trend affects the later presentation of items. Assume the entries in Table 
11 were logged by the computer in response to the consumer's selections. Also assume the ordered list of 
45 items in Table 8 makes up the complete ordered item database, if the consumer requests to see items 
which chop, cut or grind vegetables, the following list of items is collected from the ordered database in 
Table 8 and sent to a "user-presentation" routine: 



so List 1 

Items Which Chop/Cut/Grind Vegetables 



55 
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("LeChef Food Processor"' ''Self-Sharpening Knives" "Osterizer Blender" "Gourmet Cutlery Set" "Vista 
Food Processor") 

To order these items, the user presentation routine first creates the list of "important characteristics" 
5 established by looking for those characteristics which appear most frequently in Table 1 1 . In this example, 
the list is: 



TO 
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List 2 

"Important Characteristics" 
(traditional, simple) 



The item List 1 is then split into three sublists based on how many characteristics the items have in 
common with the list of "important" characteristics. First a sublist of items which have ALL the "important" 
characteristics is collected from List 1. In this case, only the Gourmet Cutlery Set is both traditional and 
simple. The remaining four items are then checked to see if they have ANY characteristics in common with 
the "important" ones. This list of partial matches contains only the Le Chef Food Processor, with "simple" 
20 as a characteristic. The remaining items are retained in their original order relative to each other based on 
their order of appearance in Table 8. The three sublists are then appended to give the final reordered list: 



List 3 

Ordered List Based On Second Induction 



All Match 

+ Partial Match 

+ No Match 



Final Ordered List 



45 



("Gourmet Cutlery Set") 
("Le Chef Food Processor") 
("Self- Sharpening Knives") 
("Osterizer Blender") 
("Vista Food Processor") 
("Gourmet Cutlery Set" 
"Le Chef Food Processor" 
"Self -Sharpening Knives" 
"Osterizer Blender" 
"Vista Food Processor") 



so 



55 



The items are then presented to the user in this new order. The second level of inductive learning 
serves to highlight specific "best guess" items by bringing them quickly to the user's view. The overall 
"flavor" of the item list is however maintained. 

As the user session progresses and other items are viewed, the Table 1 1 entries will change and a new 
characteristic could emerge as most important. The program is immediately sensitive to such changes, as 
the entire process is repeated each time a group of items is passed to the user presentation routine. The 
process is also rerun each time an item is demonstrated so that the remaining items will be ordered in the 
most up-to-date order possible. Between users, ail characteristics data stored for the previous user session 
is removed and a new table is established for the next consumer. 
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The merchandise* system in which the invention is used has been designed in layers. At the core of the 
system is a databaseeof product attributes, with videodisc information, pricing, and other product specific 
information: Above, the database is a relational network which allows the functional logic to choose and 
order rtems= based" orr desirable attribute values. Finally the user help feature extracts information from the 

r viewer, passes on the needed-data- tathe rest of the system, and prepares the responses for the user. 

This merchandiser system- has several! modes of operation which are best understood by reference to 
the -flowchart:** the system software illustrated in Figures 5a and b. Steps in the program which require 
user input are identified rirr the- flowcharts by an asterisk. As indicated in block 15 of Figure 5a when the 
system is; idle, an "attract: segment", designed to catch the eye of passers-by, is executed. The attract 

r segment consists of . a continuous loop presenting current top-selfing items, sales items, and in-store 
specials on the video monitor. The in-store specials portion of the attract segment is a written page 
descnbing .terns on special which are not necessarily on the system. This allows the system to remain 
current, without changin&the videodisc for every new product It is during the attract segment that the first 
leveltf inductive teaming, the IU program, is executed to generate a rule for the current desirable attribute 

When a user becomes sufficiently interested in the system to touch the screen, as represented by the 
block 17, he or she is taken through a: brief help segment designed to familiarize new users with the 
symbols that are used throughout the session. Then the user is presented with a main shopping menu 
which-offers OTfcfollowing.ojtf ons 

1) Help with using the system. 

2) Browsing through the catalog. 

3) Selecting a gift. 

4) Finding a specific item. 

5) Finding an item which performs a specific function. 

6) Seeing what is on sale. And one of the following: 

7) 

A. Attract segment item. 

B. "Touch the bar indicating what you would like to do". 

C. Viewing the shopping cart items. 

The user selects a segment of the program by touching the appropriate statement in the menu. The 
neip segment 19 of the program provides information to the user on the other portions of the system A 
general overview of the system and how to use the help feature is initially presented, along with a listing of 
the other system functions. The user then can choose which segments of the program to call up 

The browse segment 21 presents an overview of all the products on the system by sequentially 
presenting.on the video monitor 1, at a user adjustable rate, all of the items in the system. The items are 
sorted pnor to showing them- to the user so the items believed to be of most interest are shown first Figure 
6 : illustrates a typical display 23 for the browse segment. In addition to a color picture 25 stored on the 
videodisc of the item, the display includes symbols which enable the user to control the flow of the 
program^ For instance if the user would like to see a demonstration of the item he touches the "demo" 
symbol 27. If he would like to return to the main menu he presses the "menu" symbol 29. If the user would 
like to save the item in his "shopping cart" he presses the "save" symbol 31 which generates the "in cart" 
symbol 33 indicating that the item has been saved. 

The user can further control the presentation by touching the "go back" symbol 35 to return to an item 
that has been previously shown, the "stop" symbol 37 to freeze the currently displayed item for 20 
seconds or the "restart" symbol 39 to resume the sequencing. The items are displayed for a nominal 
interva , for instance 5 seconds, however, the user can speed up the sequence by pressing the "faster- 
symbol 41, or slow the sequence down by pressing the "slower" symbol 43. The preferred rate established 
by the user .s stored and used as the default rate for subsequent presentations to the current user 

The gift segment 45 assists the user in selecting a gift. It is based on a marketing theory which asserts 
that people should be categorized by their life styles and values when choosing suitable gifts rather than 
more typical things like income or age. Thus the gift suggestion segment 45 begins by showing 6 images 
of people and asks the user to choose which picture best describes the gift recipient When a selection is 
made, a number of gift ideas, such as four, are presented which have been determined most appreciated 
by the group chosen. If the user is not pleased with these suggestions, the system will ask more typical 
questions, for example, the hobbies and age of the recipient, or a desired price range of the gift, and then 
additional suggestions will be made based upon these selections. 
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The specific items segment 47 provides the user with two means for calling up information on a specific 
item. The user can describe the product by typing in a product name or description which utilizes a "spell" 
subroutine 49, or he can choose to see an index 51 . If the user types in a product name or description, a 
parsing routine is used to make a "best guess" 53 of what the user has requested. If the user requests a 
5 generic item, for instance blenders, all items meeting that description, and items having similar functions, 
will be selected for presentation. 

The specific function segment 55 permits the user to request a showing of items which perform a 
particular function or combination of functions. This segment is also known as "build-a-sentence", because 
when the user chooses this option, a list of verbs and nouns are presented. When the user touches a verb 
70 describing what should be accomplished, the valid nouns for the chosen verb are highlighted. The user 
completes a sentence by touching the appropriate noun and ail items fitting the description are used. The 
relational network is used to make creative as well as predictable suggestions. 

The saies segment of the program 57 allows the viewer to browse an electronic sales flyer. Any items 
on the system which have been marked "on sale" by store personnel are presented, in an order determined 
75 by the inductive learner. When all the items on the videodisc have been shown, the user has an option of 
seeing "other in-store specials". These are short, appealing descriptions of other products in the store 
which should be noticed, but which are not yet on the system. 

The last option, 7, presented to view on the main menu is dependent on the user's path through the 
system, and whether any items have been "saved" until now. When the user is first shown the main menu, 
20 after touching the screen during the attract segment, the final option given the user is to see the item that 
was on the screen during the attract segment when the user touched the screen. For example, if the user 
saw the Gourmet Cutlery Set and decided to initiate a user session by touching the screen, the final option 
would be: 

"or touch here to see the Gourmet Cutlery Set." 

25 This option is offered so that the user does not have to relocate the item which interested him in initiating a 
session. The user only has one chance to respond to this option, however, as one of the following options is 
presented in subsequent presentations of the main menu. 

If the user is not seeing the menu for the first time, the final option may in fact be just a statement 
directing user to "touch the bar indicating what you would like to do". This statement merely acts as an 

30 instruction, reminding the person to touch the screen to provide input. 

The last possibility for the final option on the main menu is to "see the items in your shopping cart." 
When the user chooses to view the items in the shopping cart, the shopping cart segment 59 of the 
program is entered. In this segment, a screen displaying all the items which have been saved is displayed. 
The user can then see a demonstration of the item, or choose items to be included in a comparison as 

35 indicated in block 61 . All the items specified will be compared and described 63. The first comparison 
prepared is a pricing comparison. In addition to the usual pricing information, the pricing comparison tells if 
there are multiple models of an item, and whether an item is on sale. Following the price information, the 
functional comparison of the items is prepared. For this comparison, items with similar functions are 
grouped together and a summary of the results is printed on the screen. Finally, the user can see a detailed 

40 description/comparison of the items. Again, like items are grouped, but this time the features are 
highlighted, first as to how the products are similar and then as to how they differ. If the items chosen from 
the shopping cart are not comparable, individual descriptions are supplied. All comparisons are created 
during the user's session, not preprogrammed, so that any changes in product features or pricing 
information would be included in reports without any programming changes required. 

45 As mentioned previously, the merchandiser system has been designed in layers. The only layer which 
the user sees is the top-most user help feature or the "communicator". The communicator performs many 
tasks, all designed to make the system more user-sensitive, responsive, effective, and generally more 
"intelligent". " r 

The most visible task which the communicator performs is the selection and offering of help to the user. 

so If the user takes longer than is "normal" to respond to a menu or choice, the communicator will select a 
helpful message based upon the user's place in the system and the path taken to reach that place, and 
print out the message in a "FYI", (For Your Information) window. The system will make three such 
suggestions, telling what the various options will do, or even suggesting an appropriate response. If no 
response is noted after the third message, the system assumes the user has left and "times-out", re- 

55 executing the first level of inductive learning, IL1, and beginning the attract segment 15. 
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Iit atidrtiorr to offering; helpful suggestions to the user, the communicator performs background functions 
which influence the user, but which are not obvious. These functions are performed by the portion of the 
software described by the flowchart of Figure 5b. After toe user branches to any of the five main user 
options (browse, gift, specific time, specific function, or sale items) the communicator accesses the 
s relational network to choose appropriate items, block. 67, and then rearranges those based upon the second 
level of inductive learning; IL2, to make a "best guess" as to what will be most interesting to this consumer 
69. Rearrangement; of the items at this point irr the program is only carried out if the current user has made 
at least two selections. For instance, if the user has just entered the system and has requested the browse 
segment there is no information available yet to deterrauae this user's preferences, and hence this 
10 rearranging subroutine is bypassed. 

Appropriate items for the mode selected by the user are displayed one at a time as indicated in block 
71 in the sequence determined by the first level of inductive learning, and the second level of inductive 
learning, If appropriate. A request by the user, block 73. for a demonstration of the item currently being 
displayed on the video monitor is used as an indication of the user's particular interest in a specific item 
is Thus, in response to a request for a demonstration, the second level of inductive learning IL2 program is 
run, block 75, while a video recording stored on the videodisc of a demonstration of the product is 
presented on the video monitor, as indicated irr block 77. The IL2 program, which is discussed more fully in 
connection wittr Figure & records the fact that the demonstration has been requested on the item, together 
>Jil T*' btm ' *"* mQnth * entry - "P 0 " completion of the IL2 program, the remaining items 
selected for the specified 1 system mode are rearranged in block 81 based on this updating of the second 
level of inductive learning, if appropriate. 

Whether or not a. demonstration has been requested, the shopper has the option of saving the item in 
his or her electronic shopping cart, block 83. Items saved by touching the save symbol 31 are stored block 
85, for further consideration. 

At any time, the user has the option, block 87, of pressing the menu symbol 29 if he or she has seen 
enough items in the present mode and desires to return to the main menu. In the absence of an indication 
mat the user wants to return to the main menu, the program loops back, block 89. to present the next item 
in the selected list of items. 

When all of the selected items have been presented, a submenu is generated, block 91. presenting the 
options available to the user. The options available depend upon the user's past activity. For example a 
user completing the gift section will be offered the option to review the gift suggestions presented, or see 
oifferent gift suggestions. If the user has saved Herns in the shopping cart, the option will be given to review 
these terns also. To enhance the versatility of this menu, the program is written to interpret the sentence 
which describes the option chosen by the user. This is done using a parsing routine, which in the 
exemplary embodiment, is a key word matching routine which analyzes the character strings and causes 
the program to branch to the appropriate routine. This allows the options to be reordered, reworded, or new 
options to be added without changing any code. 

Figure 7 illustrates the flowchart for the first level of inductive learning, IL1 . When the system times out 
indicating that the last user has terminated use of the system, the ID3 routine for the selected attributes' 
income, age, and gender in the exemplary embodiment, is run, block 93. A detailed flowchart for the ID3 
routine is illustrated in commonly owned U.S. patent application Serial No. 826,524 filed on February 6 
1986 in the names of William J. Leech and Thomas N. Dean and entitled -An Automated Rule Based 
Process Control Method with Feedback and Apparatus Therefore". For convenience, this flowchart is 
repeated and discussed in the appendix of this application. Software implementing the ID3 algorithm is 
commercally available from the assignees of this invention. Westinghouse Electric Corporation under the 
trademark MasterMinder. Herman Edge of Palo Alto, California, also markets software implementing the ID3 
algorithm under the designation Expert Ease. 

The rules derived by the ID3 routine for income, age and gender are loaded in block 95. Each of the 
rules is executed in block 97 to determine a current consumer profile by applying the rule to the data stored 
in Table 1 in the manner described previously. Each of the items is then scored in block 99 according to 
how closely they match the profile and the items are then sorted based on the score in block 101 and the 
sorted list is stored in block 103. If a new user has not touched the screen, block 105. the attract segment 
items are presented in block 107. When a new user does enter the system, the introductory page is 
presented, block 109, to instruct the user on how to use the system. 
55 Figure 8 illustrates in more detail the flowchart of the IL2 routine illustrated by the block 75 in Figure 5b 
First a check is made in block 111 to determine if the item has already been processed to prevent counting 
it twice. If the .tern has already been recorded for this user, the remainder of the IL2 routine is bypassed 
and the demonstration is played in block 77. New items for this user session are added to the item list in 
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block 113 and the consumer attribute information for the item is recorded for the first level of inductive 
learning, IL1, in block 115. If the item being examined does not have any assigned functional characteristics 
as determined in block 117, the video demonstration is played. If the assigned functional characteristic is 
already listed in the table as determined in block 119, the number of occurrences of that characteristic is 

5 incremented in block 121. If It is a new characteristic, it is added to the table with the number of 
occurrences set equal to 1, as indicated in block 123. Since an item may be assigned more than one 
characteristic, this procedure is repeated for each characteristic assigned to the item under review. When all 
of the characteristics have been recorded, or if no functional characteristic has been assigned to the item, 
the IL2 run routine is completed and the video demonstration is played in block 77. 

to Rgure 9 illustrates a flowchart for rearranging items in accordance with the second level of inductive 
learning, IL2. First the list of items to be presented is gathered in block 125. Next, a check is made in block 
127 to determine if there are any trend candidates, that is, are there any entries in the occurrence of 
characteristic tables. If not the list of items is presented as a final list in block 129 with the sequence 
unchanged. If there are any entries in the characteristic list, they are sorted by the number of occurrences 

rs in block 131. If none of the characteristics has occurred more than once as indicated in block 133, no 
significant trend has been detected and the list is not rearranged. If any characteristic has occurred more 
than twice, a list is made in block 135 of the top candidates. That is, a list of the characteristic or 
characteristics that have occurred the most number of times. Such characteristics are considered the 
important characteristic or characteristics. Next a list is made, block 137, of the items, if any, which match 

20 all of the important characteristics. A list is then made in block 139 of all of the items which have a partial 
match with the important characteristics. That is those items which are assigned at least one of the 
important characteristics. Finally a list is made, block 141, in which the item having a total match with the 
important characteristics followed by those items having a partial match are moved to the top of the list of 
selected items as ordered by the first level of inductive learning, ILL Items for which there is no match with 

25 the important characteristics remain in the sequence determined by ILL This rearranged list is then 
presented as the final list in block 129. 

A number of the features discussed above make this system unique. First is the use of inductive 
learning techniques to teach the system items of interest by determining the most desirable attributes at 
any given time based upon the input of previous users. This allows the system to be truly sensitive to user 

30 interest and to respond appropriately. One significant advantage of this is that even after a pattern has 
developed, e.g. a trend in shopping habits changes for some reason, the inductive learning program will 
detect this change and adjust the presentation accordingly. In addition, the system can tailor a presentation 
to the individual taste of the current user, again using an inductive learning program which is based upon a 
set of assigned attributes. 

as In addition to being responsive, the system is highly versatile. The versatility is achieved by reducing 
the product data base to a series of attributes based on extensive market research. The products are 
retrieved solely by their attributes, permitting items to be added or deleted, or the whole data base to be 
changed, without significantly changing the computer code. This allows the system to be generic in that any 
type of items may be added to the catalog, and they will be retrieved or sequenced using only their 

40 attribute values. Versatility is further enhanced by the system by the extensive use of automatic screen 
generation techniques such that most screens shown to the user are generated based upon the current user 
situation, making wording changes, option changes and formating changes trivial to implement. 

45 APPENDIX 

A detailed flow chart of the ID3 program suitable for generating the decision trees which derive the 
rules for the first level of inductive learning used in the present invention is set forth and described in 
commonly owned United States Patent Application Serial No. 826,524 filed on February 6, 1986 in the 
so names of William J. Leech and Thomas N. Dean and entitled "An Automated Rule Based Process Control 
Method With Feedback And Apparatus Therefore". This flow chart, which appears as Figures 8a and 6. and 
the description thereof which appears on pages 16-20 of that application, are repeated here as Figures 10a 
and b and the description below for the purpose of providing suitable means for implementing the ID3 rule 
making algorithm. 

55 Once the sample set is selected, new rules are induced as illustrated in Rgure 10. First the samples 
are input 112 and stored in a data structure, such as an array, matrix or list which is suitable for storing 
samples having multiple attributes where the samples must be sorted and subdivided during processing. 
Next, an attribute is chosen 114 for testing to determine whether it is an appropriate split node for the 
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decision tree. The attribute to be tested can be chosen arbitrarily, such as choosing the first attribute in the 
sample. The attribute is tested 116 to determine whether it is numeric. Assuming that the attribute is 
numeric, a determination tT8 is made concerning, whether the attribute has a value in each sample. If each 
attribute does not have a value, a suitable value fer that sample is generated 120 by. for example, averaging 
the attribute values or randomly picking an attribute value:. Another strategy for handling absent values is to 
create psaudosamplea to substitute for the sampfe with the missing attribute. The missing attribute value for 
the pseudosamples can be generated based on tie- distribution of the attribute values for other samples in 
the--sample set or on a distribution such as a belt curve. 

The records are sorted 122 in ascending sequence according to the attribute value for the attribute 
selected, and then the sample set is split 124 into two sets between the first and second samples producing 
a split value and a split index. Next, an information gain function for creating a decision tree is evaluated 
T26 to produce the information gain for the split previously selected. The information gain will be used to 
determine whether the tested attribute is appropriate as the split node for the current level in the decision 
tree. The calculations necessary to evaluate this preferred function will be discussed in detail later. The 
rs resulting information gain along with split values and split index are stored 128. If the last sample has not 
been reached 130. the index is advanced 132 and the sample set is split between the next two samples and 
the decision tree generation function is again evaluated. Once the end of the samples is reached, the split 
which produces the maximum information gain, along with the split value and split index, is saved 134 If 
the end of- the attributes has not been reached 136. then the next attribute is chosen and the process 
2ff continue? again. 

After a similar process is performed for each symbolic attribute, the numeric or the symbolic attribute 
having the highest information gain and the corresponding indices are chosen 158 by comparing the 
information gain for each attribute. Next, the maximum numeric and symbolic information gain values are 
compared 160 with each other, the attribute with the maximum is chosen and a decision tree record entry is 
25 created The data structure of the decision tree will be discussed in more detail hereinafter. 

After the maximum is chosen, the samples are again sorted 162, based on the selected attribute into 
ascending sequence if numeric and according to symbolic name if symbolic. Then the sample set is 
divided into subsets based on the attribute with the maximum information gain and the corresponding split 
value and split index. If all the samples in each subset have the same class values, then the decision tree 
for the subset structure and the corresponding rule is saved, if each sample in a subset does not have the 
same class values, then the algorithm is then executed for the subset as if it were the set. That is. the 
subset is treated as a set and the process of choosing attributes, sorting into ascending sequence, splitting 
and producing the information gain is executed. 

If during the execution of the above-discussed rules induction algorithm an attribute is encountered 
which requires the solution of a subproblem to produce a subrule. the subrule is produced in the same 
manner as previously described. In the preferred embodiment, the subproblems which appear in the 
pnmary problem are rule induced prior to primary problem rule induction, so that when a subproblem 
indicator is encountered, the rule for that subproblem can be made available immediately. An alternative to 
performing subproblem induction before primary problem induction, is to temporarily halt rules production 
based on the pnmary sample set while a rule is produced for a subproblem sample set. Either the preferred 
or alternate approach can be applied whenever a particular class value requires the solution of a 
subproblem. 
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1- A method of controlling a video system (1, 3) with a programmed digital computer (5) to display to 
users in a controllable sequence images of a plurality of items, said method characterized by the steps of: 
generating an attribute file containing as to each item an assigned value for at least one selected 
so attribute; 

establishing a list of said items sorted in the sequence to be presented by the video system (1 5) 
based upon the assigned values of said at least one attribute; 

controlling said video system (1, 3) to display said items in the order of said list; 
providing means (7) for users to generate inputs indicating interest in selected displayed items; 
55 . generating a data file containing as to each user input the item selected and a recurring time period 
during which the input was generated; 

determining from the attribute file the assigned value of said at least one attribute for each of the 
selected items in -the data file; 
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determining from the recurring time periods of the inputs and the assigned values of said at least one 
attribute far the selected items the most frequent value of said at least one attribute during each recurring 
time period; 

determining as to each item during the time period said input was generated the match between the 
5 assigned value of said at least one attribute and the most frequent value of said at least one attribute during 
fiat time period; and 

resorting said list of items in descending order of said match between the assigned value and the most 
frequent value during the time period said input was generated of said attribute, whereby the sequence in 
which said items are displayed changes in accordance with the responses of users during the respective 
to time periods. 

2. The method of Claim 1 further characterized in that the step of determining the most frequent value 
of said at least one attribute comprises generating a rule (10, 12, 14) from the recurring time periods in 
which the inputs are generated and the values of said attributes assigned to the selected items, and which 
rule groups together recurring time periods in which the most frequent values of said at least one attribute 

rs are the same. 

3. The method of Claim 2 further characterized in that the step of generating said attribute file 
comprises generating such a file containing as to each item an ordered group of assigned values for said at 
least one attribute, wherein said step of determining the most frequent value of said at least one attribute 
during each recurring time period utilizes the highest order value of said attribute for the selected items, 

ao and wherein said matching step takes into account the order in which the most frequent value is assigned 
to said attribute for each item. 

4. The method of Claim 3 further characterized in that each ordered value of each attribute for each 
item is assigned a numerical score, wherein the matching step comprises determining as to each item the 
numerical score assigned to the most frequent value of the attribute during the current time period, and 

25 wherein the resorting step comprises arranging the items in order of the numerical score of the most 
frequent value of the attribute for the current recurring time period. 

5. An apparatus for sequentially displaying to a number of successive users merchandise items (25) to 
which a plurality of attribute values indicative of the appeal of the item to selected classifications of users 
during a plurality of recurring time periods have been assigned, said system characterized by: 

30 a video recorder (3) in which images of said items are stored; 

a video monitor (1) on which said stored images are selectively displayed; 
interface means (7) by which users generate inputs identifying displayed items in which they are 
interested; and 

a digital computer (5) programmed to record the items identified by the inputs and a recurring time 
35 period during which each input was generated, to apply an inductive learning algorithm (ID) to the attribute 
values of the selected items to determine the most likely attribute values of items selected by users during 
each of said recurring time periods, and to select the sequence in which the images stored in the video 
recorder (3) are displayed on said video monitor (1) in descending order of a match between the attribute 
values assigned to each item (25) and said most likely attribute values for the current recurring time period. 
40 6. The system of Claim 5 further characterized in that said merchandise items (25) have assigned item 
characteristics and said computer (5) is programmed to apply a first inductive learning algorithm (ILl) to said 
attribute values of items identified by inputs by all users, to apply a second inductive learning algorithm 
(IL2) to said item characteristics assigned to items selected by the present user to determine the item 
characteristics most appealing to the present user, to adjust said selected sequence in which the items are 
45 displayed to the present user only, and to present first to the present user items assigned the item 
characteristics most appealing to the present user. 
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